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ABSTRACT 

The research discussed here had two primary purposes? 
(1) to replicate a study done by George Weber in which eight factors 
were hypothesized to make successful schools successful: strong 
leadership, high expectations, good atmosphere, strong emphasis on 
reading, additional reading personnel, individualization, use of 
phonics, and careful evaluation of pupil progress; and (2) to see if 
there were, indeed, successful inner-city schools in Massachusetts. 
Also, the study was to find out and document how these successful 
schools were different so that other schools would know what to do if 
they aspired to the same level of success. The study proceeded 
through three phases. The first phase called for the identification 
of successful and unsuccessful inner-city schools. The second phase 
called for defining the factors to be studied and methods for 
collecting and interpreting data. And the final phase, not yet 
completed, called for reporting findings. The set of factors studied 
were mostly drawn from ffeber (with some wording changes) , with two 
additional factors, related to the attributes of teachers, added; 
leadership, coordination, additional reading personnel, atmosphere, 
individualization, evaluation, expectation, use of phonics, trainina 
and experience, and, quality of teaching. However, there were no main 
effects on success of school for any one of these factors. 
(Author/JM) 
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READING SUCCESS IN INNER-CITY SCHOOLS. 
1974 - AERA - PAPER 

Why do some 1nner-c1ty elementary schools succeed 1n the dob of teaching 
children to read while most others fall? Despite the several national studies 
that have suggested that home Influence Is the predominate factor 1y explain- 
ing school success, are there not some 1n-school factors that are also im- 
portant? If there are, what are they? Can their existence 1n successful 
schools and nonexistence 1n unsuccessful schools be documented? And, finally, 
arc these factors transportable to unsuccessful schools? 

The Massachusetts Advisory Council on Education, an independent slate research 
agency, became interested in these questions and their possible answers about 
two years ago. What perked the Council's Interest was a publication issued 
by the Council for Basic Education entitled, Inner-City Children ugg 
To Read; Four S uccessful Schools. The study, carried out bv George Weber, 
not only suggeste<Tthat scrTooTOb make a difference but went jo. far as to sug- 
gest how they make a difference. Weber noted eight factors which, Inhis 
judgment (based on his observations In four inner-city elementary schools whose 
students had higher than expected reading scores) made successful schools suc- 
cessful : 

strong leadership 
high expectations 
good atmosphere 
strong emphasis on reading 
additional reading personnel 
individualization 
use of phonics 

careful evaluation of pupil progress 

While Weber's work was Important, because of what it suggested schools might 
do to help students read at higher levels, the Journa istlc na Jure of Weber 's 
account and the fact that he did not seek to substantiate Ms findings by ex- 
amining unsuccessful schools, made It advisable to study his finding in a more 
rlgSrSus fashion. In short, a research study careful v matching successful 
schools with appropriate unsuccessful schools was called for. 

To do this study, the Council contracted with Educational Research Corporation 
(ERC) of Watertown, Massachusetts, to replicate the Weber study and to see if 
there were, Indeed successful inner-city schools in Massachusetts. A Ho, the 
study was to find out and document how these successful schools were ^rent 
so that other schools would know what to do if they aspired to the same level 
of success. What the Council hoped for, and ERC agreed to do, was develop a 
prescription for reading success 1n inner-city schools. 

The study proceeded through three phases, each of which will be Ascribed In 
~ this paper? The first phase called for the Identification of successful and 

unsuccessful 1nner-c1ty schools. The second phase called for defining the 
^ factors to be studied and methods for collecting and Interpreting data. And 
the final phase, not yet completed, for reporting findings. 
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The first step 1n Identifying successful and unsuccessful 1nner-c1ty schools 
was to find dty schools predominately populated by students from poor fami- 
lies. Starting with a preliminary identlf cat on, from ESEA Title ! fiscal 
allocations, of the Massachusetts cities with largest number of poverty stu- 
dents, the study proceeded sequentially to: 

screen schools within these cities 
that showed high proportions (from 
Title I application forms) of child- 
ren 1n that school's attendance area 
from low-Income families. 

apply data on free lunch and milk 
programs to Income Information to de- 
velop a combined poverty Index that 
would be more valid than using either 
Title I or free lunch and milk data 
alone. 

Since the poverty data would be verified later, the s^.P^S^tSS 15 * 
Identify successful and unsuccessful schools from the pool of appllcan t 
schools that had passed the poverty test. Drawing upon the results of exist- 
ing dty-w1de testing programs (although 1n some Instances special testing 
wal admlnlsilred) thl study purposely used the results of slxt h fj^ers be- 
cause 1t was felt that tests at this grade level would assess the cumu latlve 
learning of reading through the elementary school years. Olff erent JWfwhes 
to reading and the Inability of many younger children to cop e «}th written 
tests dictated waiting until sixth grade when results, that earlier might have 
been misinterpreted, could be better judged. 

From the preceding, ten dty schools (1n six cities) were Identified where 
children from poverty backgrounds had standardized test results at or above 
national norms. Some cities which had schools meeting poverty criteria had, 
unfortunately, no schools with good reading scores. 

Also from the same Title I, free lunch applicant pool, 10 unsucce ss ful, or as 
the study later referred to them, contrast schools were ^"w* ™iL 
the study was able, 1n five cases, to Identify contrast schools In the same 
dty as the successful schools, 1n the five remaining Instances this was not 
possible. Comparable to the successful schools 05 pjver^ measures, the con- 
trast schools nevertheless averaged 1.3 grade equivalents below national norms 
on their reading scores. Since poverty factors had been controlled for , an 
examination of 8 other H factors that could account for the differences between 
contract and successful schools was now 1n order. 

The first step, therefore, 1n the second phase of the study was to describe 
in detail and in operational terms the set of factors to be s.tudled In both 
schools. Since the study's final report will provide readers *1th full 
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descriptions of the factors 1t 1s not necessary here to more than list them: 

leadership 
coordination 

additional reading personnel 
atmosphere 
Individualization 
evaluation 
expectation 
use of phonics 
training and experience 
quality of teaching 

As can be seen, while most of the factors are drawn from Weber (with some word- 
ing changes), two additional factors, related to the attributes of teachers, 
were added. This was done simply because previous research (e.g., Coleman, 
Benson) had suggested some correlate between certain teacher attributes 
and student achievement. 

Having Identified the factors to be studied, the next step was to collect data 
about thesS factors. A wide array of data collection Instnjments were used 
.... some borrowed .... a few developed .... most adapted to the neeas 
of the study. A§a1n, readers must be referred to the final report (expec ted 
publication date - September 1974) for deta Is on these Instruments. It will 
have to be sufficient at this point to simply list them by title: 

Central Office Interview 

Principal Interview 

Teacher Interview 

Reading Specialist Interview 

Librarian Interview 

Principal Questionnaire 

Reading Specialist Questionnaire 

Teacher Questionnaire 

Literature Survey 

Classroom Observation 

Learner Activity Index 

Teacher Time Log 

Reading Attitude Inventory 

Student Questionnaire 

A few of the major characteristics of the data collection procedures ought to 
be mentioned in passing: 

data was collected "blind." That is each field investigator did not 
know whether he was visiting a successful or unsuccessful school. 

five visits were made to each of the ten successful and ten contrast 
schools .. two by a reading expert, two by study staff members, 
and one by the assistant project director. 

the observation schedule permitted one visit from each of two dif- 
ferent observers at different times in the same randomly selected 
classroom. 
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besides classroom observation each field Investigator also planned 
a series of Interviews with the school principals and staff* and 
administered the survey and questionnaire forms as previously noted. 

sometimes the same questions were asked of different respondents In 
the Interview wd questionnaire so as to compare perceptions of simi- 
lar phenomena. 

to verify that the school pairings were comparable on external fac- 
tors (a) principals were asked to supply data on racial mix, b1- 
Hnguallsm, student mobility and so on and (b) students were asked 
to supply data on their home backgrounds (e.g., education of parents, 
parental aspl rations , etc. ) . 

As might be expected, there were difficulties 1n collecting some of the data 
and some of the data that was collected could not be taken at face value. 
Despite these difficulties .... or rather because of them, the study team 
decided to maintain the "blindfold" approach 1n analyzing and Interpreting 
the data. In addition, because so much of the data was clinical and required 
judgmental procedures, 1t was decided to attempt to make such judgments as 
objective as possible by adapting Delphi techniques to the judgmental process. 
That Is, a form of collective judgment procedures was established. 

The procedures called for collective judgments to be expressed on each of the 
ten factors on a f1ve-po1nt rating scale. At one end of the rating scale 
(assigned a point value of 5) Indication was to be given that on that factor 
alone the school looked definitely like a successful school. On the other ex- 
treme (assigned a point value of 1) Indication was to be given that on that, 
factor the school 1n question definitely looked like a contrast school. 

The method of making collective judgments was to be consensual. A group of 
judges, Including those who had visited the schools, Individually reviewed 
all the data on each school. The group then met 1n order to make judgments 
along the f1ve-po1nt rating scale. Discussions were held about the data as 
It related to each factor. At the conclusion of discussions, each judge made 
a rating on the scale to Indicate the probability that the school was a success- 
ful school as far as the particular factor under discussion was concerned. 

If all the votes agreed, then the unanimous rating became the collective rating. 
If the ratings differed, further discussions were held until, on repeated bal- 
loting, a unanimity was reached. The procedure was not, as can be seen, a 
simple averaging of Individual ratings but a rating that the entire group of 
judges felt after discussion was the true rating. 

As 1t came out, not only were the groups able to achieve unanimity but, In many 
cases, they were able to achieve, and, 1n fact, desired to do so, unanimity 
using pluses and minuses on the f1ve-ao1nt scale. One Important reason for 
being able to achieve consensus was the fact that at any time, the review Judges 
could review ratings given to other schools on a given factor and, therefore, 
ask themselves how the current school compared to that factor. In short, the 
fact that comparisons and contrasts could be made without difficulty expedited 
the consensual approach. 
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The last Phase of the study, as mentioned earlier, 1s reporting on findings. 
Currently, the study team 1s 1n the midst of interpreting data, and, at the 
same time, planning to extend the research, 1f proper funding can be obtained, 
for two more years. The need to take a longitudinal look at the schools is 
to see how the factors cited or combinations of these factors act over time, 
and with changes in pupil performance. In short, are there factors or clus- 
ters of factors that move in tandem? In addition, subsequent research win 
seek to augment the school factors cited with additional child-centered ones 
(e.g., attitudes, self-image, perception of teacher, etc.). In fact, trie 
study team has already begun to collect some of this additional Information. 

Although 1t is premature to announce any findings, the study team's analysis 
thus far does indicate that the identification of successful schools 1s not 
associated with the presence or absence of any of the factors mentioned, in 
a phrase, there were not main effects. Where a factor was present in" a sue- 
cessful school; it was also found to be present in some of the contrast schools, 
Reversely, some factors were foi^d to exist in the contrast schools and not in 
the successful schools. 

For example: 

in one, pairing an extremely high level of coordination and emphasis 
on reading were found to exist 1n the contrast school but not in 
its paired successful school. In fact, in this instance, the pro- 
file of the successful school looked more like what a contrast 
school is thought to look like! 

1n one successful school, a high level of leadership, coordination, 
emphasis on reading and teaching quality was judged to exist but 
in the paired contrast, more reading personnel and a work-oriented 
and purposeful atmosphere existed. 

there were no clear and predominate characterizations of three 
factors: individualization, evaluation and expectations in any 
of the successful or contrast schools. 

there were twelve ratings of 4 ©r better (probably or definitely 
a successful school) in the successful schools; eleven ratings of 
4 or better 1n the contrast schools. 

. 57^successful schools were rated below four on all factors, four 
contrast schools were rated below four on all factors. 

To say the least, the preceding is not encouraging. It certainly does not 
end encouragement to those school districts who are placing their money on 
tuber's findings. For if anything the study contradicts the idea that suc- 
cessful reading can be brought about by the Induction of J2 ?! ImT** 
such as Weber's. More likely, there are a multiplicity of ways 1n which 
schools change or are successful. The continuation of the present research 
will hopefully uncover some of these ways. 
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